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Prove that finding the maximum intensity value in a digital image is a nonlinear operation 


Image filtering using the median of the pixel neighborhood is useful in removing certain kind of 
noise. The median, l , , of a set of numbers is such that half the values in the set are below \ and 
the' other half are above it. For example, the median of the set of values {2, 3, 8, 20, 21, 25, 31} is 
20. 

a) Show that an operator that computes the median of .a sub-image area, S, is nonlinear. 

b) Is it possible to apply the median on images using a mask and the correlation? Why? 


3. 



Imaging under very low light levels causes the imaging system sensor noise largely affects the 
resulting images. Let g(x,y) denote ^corrupted image formed by the addi tion of sensor 
noise: r)(x,y) to the scene noiseless 'image /(x,y ); -that \s fg(x,yY^ fXx.yfl rjjx.'y /l In a 
process of noise reduction, a set of noisy images [ggx, y)} for the same scene are averaged to get 
a less affected by noise image. Assume that at every pair of coordinates {x, y} the noise in the. 
added images is uncGrreiaied and has zero average value. 

a) Prove that the expected value of the image formed by averaging K different noisy images 
is the noiseless image f(x,y) 

b) How the variance and the standard deviation of the average image is related to the 
variance and the-standard deviation, respectively, of the noise. 

c) Mention the condition that must be satisfied when practically applying the process for 
reducing the noise 


pzrA 


Image subtraction is used often in industrial applications for detecting missing components in 
product assembly. The approach is to store a "golden" image that corresponds to a correct 
assembly; this image is then subtracted from incoming images of the same product. Ideally, the 
difference would be zero if the new products are' assembled correctly. Difference images for 
products with missing components would be non-zero in the area where they are differs from the 
golden image. What conditions do you think have to be met in practice for this method to work? 


Consider two 8 bit images whose intensity levels span the full 
limiting effect of repeatedly subtracting image 2 from image 
represented in 8 bits . . . ' 7 ' . 


range from’ 0 to 255. Discuss the 
1. Assume that the result also is 


6. For the figure shown, sketch the set A n B) U (A U B) c 
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7. a) Discuss one application of image addition 'i € 4 UC.qJtvG'Vn. 

b) . Discuss one application for image subtraction 

b'j, CUV emcj \(@ 
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1. Ail operation H on a digital image f(x, y) is linear if and only if it satisfies two conditions: 

H W ' (*> JO] = «//[/ [x, y)] (homogenei ty ),and 

Il[ a ,f(. x >y) + a j f J {s,y)\^a l H[f l {x,y)\+a J H\f J (x,y\(svg)erposi\or\) ) 

Then one example that demonstrates that one of these conditions is not applicable for a given ' 
operation is sufficient as a proof for the nonlinearity of the operation. Here is an example that 
demonstrates the violation of the superposition for the maximum pixel value operation. 

m 4 »[! %-»\ 6 sr 


2 3 


4 7 


= Max- 

white 

(l)Max 


::l- 

[:3 


(-l)Mxc- 


[6 


= 3 - 7 = -4 

Hence, in general theoperationis nonlinear 

a) 

The median of a sub image is a linear operation if and only if 
Median[a,J x {x,y ) .+ a 2 f 2 (x,y)] = a x M,edian[f x (x>y)) + a 2 Median[f 2 (x,y .)]. 
For any real constants a^ and a 2 , where hand f 2 are anytwo sub-images. 

let A - [4 

MedianlAix.y)] = 1 , Median[f 2 (x,y )] = l,let a t = 1 and a 2 = 

LHS of Cl): a 1 Median[f 1 (x, y)] + a 2 Median[f 2 (x,y)] = 7-1 = 6 

f l 2 3 
4 5 6 


(1). 
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4 
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0 
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1 
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8 
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.2 

0 

0. 


So, the median operation is not linear 
b) 


5 st LHS 


NO. A mask and correlation is used in linear filtering only and cannot be used to apply nonlinear 
operation 


3. = (a) 

The average at any pair of coordinates (x,y) of a set of K images is given by 
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1 k 1 e ^ k 

3(x.y) = xY. 3i (x ‘ y) = kY, fi (x ' y) + kY, 7)1 y) 

i=l i=l i = 1 

f £ K \ 

E I g(x,y)} = E j-^T fi (x, y) + r/ e (x, y) j 


Applying that the expected value of the sum is the same as the sum of the expected values of the 
items included in the sum . 


E{g(x,y) j = £{//(*, y)} + Efrdx.y)} 

The expected value of a constant is the constant itself. This fact applies on fi(x,y ) since the value 
of the original image is always the same; that is a constant. Another probability rule says that the 
expected value of a random variable of a given mean is the mean itself. This rule applies on 
r)i(x,y) that has a zero mean as stated above. Hence, 


E{gfryj} = f(x,y) 


(b) 

Restarting from the equation 


1 k i k ^ K 

S( x >y ) = m fey) = fey) + m fey) 


It is known from random-variable theory that the variance of the sum of uncorrelated random 
variables is the sum of the variances of those variables. In addition, the variance of a constant 
value fi(x,y ) is zero. Then, we can write 

° 2 gOcy) = ff 2 f(x.y) + l^Vi (x.y) + fry) f ff 2 y K(x.y)] 

.... = K2 \ a 2 ih(x,y) + ff 2 r)2(x.y) + + a 2 VKix.y\ 

But rji are samples of the noise f) that has a single variance which is er 2 r,(xyy Hence, 

2 K \ 1 2 

a g(x.y) ~ % 2 fe v(.x,y)j ~ K a nix.y) 

The relation of standard deviation is obtained by just taking the square root of both sides in the 
above equation. 


1 

a g(xy) 

(c) . ’ ■ 

The condition that must be satisfied when practically applying the process is that the image to be 
averaged must be registered (aligned) in order to avoid the introduction of blurring and other 
artifacts in the output images 


4. Let g (x,y ) denote the golden image, and let f(x,y ) denote any input image acquired during 
routine operation of the system. Change detection via subtraction is based on computing the 
simple difference d(x,y) = g(x,y}- f (x,y). The resulting image,d (x,y), can be used in 
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two fundamental ways for change detection. 

One way is pixel-by-pixel analysis. In this case, we say that/(x,y ) is "close enough" to the golden 
image if all the pixels in d (x,y ) fall within a specified threshold band [T mi „ r T mox ] where T min is 
negative and T mm is positive. Usually, the same value of threshold is used for both negative and 
positive differences, so that we have a band [~T,T\ in which all pixels of d (x,y ) must fall in order 
for / (x, y ) to be declared acceptable. 

The second major approach is simply to sum all the pixels in d (x,y ) and compare the sum 
against a threshold Q. Note that the absolute value needs to be used to avoid errors canceling out. 
This is a much cruder test, so we will concentrate on the first approach. 

There are three fundamental factors that need tight control for difference based inspection to 
work: • 

(1) Proper registration 

(2) Controlled illumination 

(3) Noise levels that are low enough so that difference values are not affected appreciably by 
variations due to noise. 

The first condition basically addresses the requirement that comparisons be made between 
corresponding pixels. Two images can be identical, but if they are displaced with respect to each 
other, comparing the differences between them makes no sense. Often, special markings are 
manufactured into the product for mechanical or image-based alignment. 

Controlled illumination (note that "illumination" is not limited to visible light) obviously is 
important because changes in illumination can affect dramatically the values in a difference 
image. One approach used often in conjunction with illumination control is intensity scaling based 
on actual conditions. For example, the products could have one or more small patches of a tightly 
controlled color, and the intensity (and perhaps even color) of each pixels in the entire image 
would be modified based on the actual versus expected intensity and/or color of the patches in 
the image being processed. 

Finally, the noise content of a difference image needs to be low enough so that it does not 
materially affect comparisons between the golden and input images. Good signal strength goes a 
long way toward reducing the effects of noise. Another (sometimes complementary) approach is 
to implement image processing techniques (e.g., image averaging) to reduce noise. 

Obviously there are a number if variations of the basic theme just described. For example, 
additional intelligence in the form of tests which are more sophisticated than pixel-by-pixel 
threshold comparisons can be implemented. A technique used often in this regard is to subdivide 
the golden image into different regions and perform different (usually more than one) tests in 
each of the regions, based on expected region content. 

5. (a) ' 

Pixels are integer values, and 8 bits allow representation of 256 contiguous integer values. In our 
work, the range of intensity values for 8-bit images is [0,255]. The subtraction of values in this 
range covers the range [-255,255], This range of values cannot be covered by 8 bits, but it is given 
in the problem statement that the result of subtraction has to be represented in 8 bits atso/anS, 
consistent with the range of values used for 8-bit images, we assume that values of the 8-bit 
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difference images are in the range [0,255], What this means is that any subtraction of 2 pixels that 
yields a negative quantity will be clipped at 0. 

The process of repeated subtractions of an image b(x,y ) from an image a(x,y ) can be expressed 
as 

K 

d k (x,y) = a(x,y ) - ^ b(x,y) 
a(x,y)-Kxb(jx,y ) 

Where d K (x,y ) is the difference image resulting after K subtractions. Because image subtraction is 
an array operation (see Section 2.6.1), we can focus attention on the subtraction of any 
corresponding pair of pixels in the images. We have already stated that negative results are 
clipped at 0. Once a 0 result is obtained, it will remain so because subtraction of any nonnegative 
value from 0 is a negative quantity which, again, is clipped at 0. Similarly, any location (x 0 ,y 0 ) for 
which b(xo,y 0 )= 0, will produce the result dK(x 0 ,yO)= a(x 0 ,y 0 )- That is, repeatedly subtracting 0 from 
any value results in that value. The locations in b(x,y ) that are not Owill eventually decrease the 
corresponding values in d K (x,y ) until they are 0. The maximum number of subtractions-m which 
this takes place in the context of the present problem is 255, which corresponds to the condition 
at' a location in which a(x,y ) is 255 and b(x,y ) is 1. Thus, we conclude from the preceding 
discussion that repeatedly subtracting an image from another will result in a difference image 
whose components are O in the locations in b(x,y ) that are not zero and equal to the original 
values of a{x,y ) at the locations in b(x,y ) that are 0. This result will be achieved in, at most, 255 
subtractions. 

6. (a) 



7. a) Noise reduction by averaging is an application of image addition, especiaily in astronomy. 

Images taken under very low light level frequently causes sensor noise render single image 
virtually useless for analysis. Averaging a 'number of images taken for the same scene 
under low light level reduces the noise contents in the average image. As the number of 
images averaged increases as the noise content in the resuiting average image decreases. 
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b) Enhancement of differences between images is an application of image subtraction. Mask 
mode radiography is based on image subtraction. A mask h(x , y) is an X-ray image of a 
region of the patient's body. The procedure consists of injecting an X-ray contrast medium 
into the patient's bloodstream, taking a series of images caiied live images of the same 
region as that of h(x , y), and subtracting the mask from the series of incoming live images 
after injection of contrast medium. The net effect of subtracti ng the mask fro m each 
sample live image is that the areas under that are different between the live image aricl 

the mask appears in the output image enhanced. 
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